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(54) System for 3D Ultrasound-guided Intraoperative prostate brachytherapy 



(57) The present invention is directed to a 3D ultra- 
sound-guided intraoperative braclnytinerapy system for 
the diagnosis and treatment of prostate cancer in men. 
The method to be used with the system comprises the 
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Description 

[0001] The present invention is directed to tine diagnosis and therapy of prostate cancer in men. IVIore particularly, 
the invention is directed to a 3D ultrasound-guided intraoperative brachytherapy method, system, apparatus and use of 

5 the apparatus in a method for the diagnosis and treatment of prostate cancer. 

[0002] Prostate cancer is the most commonly diagnosed malignancy in men over the age of 50, and is found at 
autopsy in 30% of men at the age of 50, 40% at age 60, and almost 90% at age 90. Worldwide, it is the second leading 
cause of death due to cancer in men, accounting for between 2.1% and 15.2% of all cancer deaths. In Canada, about 
20,000 new prostate cancer cases will be diagnosed and about 4,000 men will die from this disease every year. 

10 [0003] Symptoms due to carcinoma of the prostate are generally absent until extensive local growth or metastases 
develop, accounting for the fact that only 65% of patients are diagnosed with locally confined disease. Once the tumour 
has extended beyond the prostate, the risk of metastasis increases dramatically. Tumours smaller than 1 to 1.5 cm^ 
rarely broach the prostatic capsule. When diagnosed at this early stage, the disease is curable, and even at later stages 
treatment can be effective. Nevertheless, treatment options vary depending on the extent of the cancer, and prognosis 

15 worsens when diagnosis occurs at an advanced stage. 

[0004] The prostate-specific antigen (PSA) blood test has become well established for early detection of prostate 
cancer, and for monitoring of prostate cancer particularly after treatment. The wide availability of the PSA test, the pub- 
lic's Increased awareness about prostate cancer, and the growing number of men approaching the age of 50, have all 
combined to increase the proportion of prostate cancer diagnosed at an early-stage. Currently, 77% of men are diag- 

20 nosed to have early stage prostate cancer, compared to only 57% between 1975 and 1979. Managing and treating 
these increasingly early stage cancers has generated a great deal of debate in both the medical community and the 
public. 

[0005] The standard treatment regimens for prostate cancer are: watchful waiting, radical prostatectomy, external 
beam radiation, and brachytherapy. While watchful waiting is appropriate for some, the majority of men diagnosed with 

25 early stage cancer will request or need treatment. There is a growing belief that aggressive therapy may not be justified 
for early stage disease due to the morbidity (incontinence and impotence) of radical prostatectomy. External beam radi- 
ation is effective, but requires long treatment times and results in irradiation of normal tissues. Conformal radiation ther- 
apy of the prostate may reduce this problem, however, early reports are mixed. In addition, costs are high in treating 
and managing patients undergoing these traditional forms of therapy. 

30 [0006] The challenges facing physicians managing patients with possible prostate cancer are to: (a) diagnose clin- 
ically relevant cancers at a stage when they are curable, (b) stage and grade the disease accurately, (c) apply the 
appropriate therapy accurately to optimize destruction of cancer cells while preserving adjacent normal tissues, (d) fol- 
low patients to assess side effects and the effectiveness of the therapy. U.S. Patents 5,562,095, 5,454,371 and 
5,842,473 are directed to methods and systems for developing 3D ultrasound images which can be used for diagnosing 

35 clinically relevant cancers at curable stages and staging and grading the cancers. Hence these patents provide 3D 
ultrasound methods which address (a) and (b) as described above. 

[0007] In the past 10 years improvements in imaging technology, computer aided dosimetry, and new treatment 
options have stimulated investigators to search for alternative approaches such as minimally invasive therapies for 
localized prostate cancer, e.g., brachytherapy, cryosurgery, hyperthermia, interstitial laser photocoagulation (I LP), and 
40 photodynamic therapy (PDT). Of these techniques, brachytherapy is the most advanced and is now considered to be a 

definitive treatment option for early stage prostate cancer. 

[0008] Minimally-invasive procedures are revolutionizing surgery and therapy, because they offer significant reduc- 
tions in patient morbidity, recovery time, hospital stay, and overall cost, while preserving or increasing clinical efficacy 
greatly benefiting both the patient and the health-care system. Clearly, a minimally invasive procedure for prostate can- 

45 cer providing these benefits is welcome, especially because of the significant morbidity currently associated with tradi- 
tional therapies. Because imaging is critically important to the safe delivery of the therapy, the major imaging companies 
are manufacturing CT (computer tomography) and MRI (magnetic resonance imaging) scanners that allow minimally 
invasive procedures to be performed under direct imaging guidance. However, conventional CT does not have real-time 
imaging capability, and both CT and MRI are expensive technologies requiring a special facility. Ultrasound is a much 

50 cheaper and more flexible imaging modality. Unlike CT or MRI, which are often located in dedicated suites specifically 
built to accommodate their needs, the ultrasound machine can be moved to the operating room as needed. Moreover, 
with ultrasound, the surgeon or therapist sees what is happening as it occurs, in real time. As a result, percutaneous 
ultrasound-guided prostate therapy techniques are currently under intense investigation. 

[0009] It was therefore required, to provide a safe and effective minimally-invasive method for the diagnosis and 
55 therapy of prostate cancer that would not only allow for the application of appropriate therapy but also allow the assess- 
ment of patient side effects and the effectiveness of the therapy. The method of the present invention addresses these 
clinical requirements utilizing the benefits of 3D ultrasound together with intraoperative brachytherapy in order to pro- 
vide a superior and more accurate method of assessing, suitably treating and following-up the progression and treat- 
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ment of prostate cancer than currently known traditional methods. 

[0010] In the present invention, the Applicant provides a novel method and system to apply an appropriate therapy 
accurately to the prostate and to follow-up with patients to assess side effects and the effectiveness of the therapy using 
3D ultrasound imaging. Preferably, intraoperative brachytherapy of the prostate is done using TRUS. The present inven- 
5 tion is an extension of the Applicant's developments in 3D ultrasound to 3D ultrasound-guided intraoperative brachy- 
therapy. 

[0011] The present invention utilizes a 3D ultrasound imaging system allowing all aspects of the procedure to be 
carried out intra-operatively, accurately and consistently in one session, including: semi-automated prostate margin and 
volume definition, real-time 3D implant guidance, verification of needle placement, and post-implant radioactive seed 
10 deposition verification. Dose planning is integrated with the present invention to allow near real-time (e.g., 0.5 sec per 
seed) dose updates and on-line corrections of the plan based on the actual prostate implant geometry during the 
implantation. 

[001 2] In accordance with an object of the present invention there is provided a 3D ultrasound guided intraoperative 
method for the diagnosis and treatment of diseased tissues, the method comprising the steps of: 

15 

a pre-implant planning phase for producing a 3D tissue image comprising shape and volume of said tissue and sur- 
rounding structures and determining optimal distribution of a selected therapy; 

a needle implantation phase for needle and positioning segmentation for delivery of the selected therapy to said 
tissue; and 

20 - a post-plan monitoring phase to verify the therapy implantation and for allowing error correction. 

[0013] Preferably, the method is used to diagnose and treat prostate cancer in men however, the method can be 
extended to diagnose and treat several different tissues such as the liver, breast and brain. 

[0014] While the method is especially beneficial to treat prostate cancer with brachytherapy, the method may also 
25 be used with other therapies such as cryosurgery, photodynamic therapy, photocoagulation and thermal therapy. 

[0015] In accordance with another object of the present invention there is provided a 3D ultrasound-guided intraop- 
erative brachytherapy method for the diagnosis and treatment of prostate cancer, said method comprising: a pre- 
implant planning phase for producing a 3D image of the prostate and surrounding structures and determining optimal 
distribution of the brachytherapy; a needle implantation phase for needle segmentation and positioning for delivery of 
30 the brachytherapy to the prostate; and a post-plan monitoring phase for verifying the needle implantation of the brach- 
ytherapy and for allowing error correction during the needle implantation phase. 

[0016] In accordance with a further object of the present invention there is provided a 3D ultrasound guided intra- 
operative system for the diagnosis and treatment of prostate cancer, said system comprising: a 3D TRUS transducer 
for producing a 3D image of said prostate and surrounding structures; a first computer means for determining a needle 
35 trajectory for optimal distribution of brachytherapy; at least one needle for implanting brachytherapy to said prostate 
along said needle trajectory; and a second computer means for verifying implantation of said brachytherapy to said 
prostate. 

[0017] Embodiments of the invention will now be described, by way of example, with reference to the drawings, of 
which: 

40 

Figure 1 shows a flow chart of the steps involved and the software modules involved in the pre-implantation step of 
the present method. 

Figure 2 shows a flow chart of the steps involved and the software modules involved in the segmentation step of 
the present method. 

45 Figure 3 shows a flow chart of the steps involved and the software modules involved in the segmentation step of 

the present method. 

Figure 4 shows a flow chart of the steps involved and the software modules involved in the implantation step of the 
present method. 

Figure 5 shows a flow chart of the steps involved and the software modules involved in the post-implantation step 
50 of the present method. 

Figure 6A shows the motorized assembly housing of the side-firing-linear TRUS transducer. When activated, the 
motor causes the transducer to rotate about its axis. 

Figure 6B shows a prostate cancer patient positioned in the lithotomy position for a cryosurgical procedure. The 3D 
TRUS system is positioned in the rectum with a localizing grid positioned on the patient's perineum. 
55 Figures 7A - 7F show examples of three 3D TRUS examinations of patients with prostate cancer. Figures 7A and 

7B are of a patient with a left base tumor (green arrows). The 3D images have been sliced in different planes to 
reveal the tumor. The coronal view cannot be obtained using conventional 2D TRUS. Figures 7C and 7D are of a 
patient with a subtle apical tumor [T and arrow, respectively). Figure 7E shows contrast enhanced 3D TRUS image, 
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showing increased vascularity on one side of tlie prostate. Figure 7F sliows tine same 3D image as in 7E, but after 
maximum intensity projection from tine coronal perspective showing the increased vascularity. 

Figures 8A - 8D show operating room 3D images of a 57 year old patient with recurrent prostate cancer following 
radiation three years previously. Figure 8A shows a coronal view of the prostate following insertion of a needle and 
5 such view was not available on standard 2D ultrasound. The arrows indicate the prostate edge. Figure SB shows 

coronal and sagittal views showing a simulated needle trajectory as a superimposed yellow line. Figure 8C shows 
an axial view with simulated localizing grid lines and one selected trajectory. Figure 8D shows sagittal and axial 
views showing the selected needle trajectory. 

Figure 9A shows a schematic diagram illustrating the 3D TRUS assembly in position for a 3D scan and a needle 
10 being inserted through the tilting needle guidance template. 

Figure 9B shows a schematic diagram showing (a) interference of the pubic arch, and (b) the template being tilted 
to allow better coverage of the prostate. 

Figure 10 shows preliminary needle segmentation results. (A) the original ultrasound image showing a needle in 
the agar phantom. (B) image after convolution with an 11 x 1 1 variance kernel. (C) after thresholding. (D) after per- 
15 forming a binary closing operator. (E) after principle component analysis. (F) after detection of needle tip. 

Figure 1 1 shows 3D TRUS images obtained during a cryosurgery procedure. Coronal "cut" which can only be 
obtained with 3D TRUS shows (A) right needle has been deflected; and (B) correct insertion of needle after with- 
drawal and re-insertion. 

Figure 12 shows preliminary results of the needle segmentation algorithm. (A) difference in needle trajectory angle 
20 between segmentation algorithm and physical measurements, shown versus measured insertion distance Dp^y. 

Error bars represent observer standard deviations. (B) difference between algorithm and observer segmented tip 
positions shown versus physical measured tip position, Dp^y. Error bars represent physical measurement uncer- 
tainty. 

25 [0018] In the drawings, preferred embodiments of the invention are illustrated by way of example. It is to be 
expressly understood that the description and drawings are only for the purpose of illustration and as an aid to under- 
standing and are not intended as a definition of the limits of the invention. 

[0019] The present invention is a novel apparatus and method based on the use of 3D ultrasound in order to con- 
duct intraoperative prostate brachytherapy in an accurate and consistent manner. 

30 

2D Transrectal ultrasound guided permanent implant prostate brachytherapy 

[0020] Prostate brachytherapy is a form of radiation therapy in which about 80 radioactive seeds (e.g., ^^^1) are 
placed directly into the prostate, either temporarily or permanently. Because the control rates of prostate cancer appear 

35 to be dose dependent, it is theorized that the higher doses produced by brachytherapy will yield higher control rates 
than external-beam radiation without a rise in complications. Recent brachytherapy literature suggests that it has a role 
in the treatment of early-stage prostate cancer, and also that it may be comparable or even preferable to surgery and 
external-beam radiation in some patients when evaluated by current therapeutic and economic endpoints.^ 
[0021] While removable implant techniques are being developed and used in some institutions, the most common 

40 form of brachytherapy involves implanting the sources permanently in the prostate. In either technique, in order to 
deliver a high conformal dose safely to the prostate, radioactive sources must be positioned accurately within the 
gland.^ In the pioneering days of brachytherapy, open laparotomies were performed, and the oncologist inserted seeds 
directly into the gland either suprapubically or transperineally with manual guidance from the suprapubic or retropubic 
approach. Without visualizing of the prostate interior from the transperineal approach, accurate positioning of the seeds 

45 in three dimensions was impossible. 

[0022] Transrectal ultrasound (TRUS), introduced in 1 971 , allowed direct visualization of the prostate. The introduc- 
tion in the mid 1980's of higher frequency (5 & 7 MHz) real-time TRUS transducers resulted in higher image resolution 
and better display of anatomy. Over the past decade the TRUS-guided prostate brachytherapy procedure has increased 
in popularity. Currently, the most common approach makes use of CT- or ultrasound-based dose pre-implantation plan 

50 to determine the total activity and distribution of the radioactive seeds in the prostate. At a later patient visit, the seeds 
are implanted on an outpatient basis under general or spinal anaesthesia, while the patient is placed in the "same" 
lithotomy position as the pre-plan. This procedure is now carried out under TRUS guidance, but some institutions use 
fluoroscopy. After the implantation at a separate patient visit, the actual seed locations are determined with CT or fluor- 
oscopy and a post-implantation plan is generated. 

55 [0023] Typically, a biplane TRUS probe is used, which contains a side-firing linear transducer array and an addi- 
tional curved array positioned near the tip producing an axial view perpendicular to the linear array. The probe is cov- 
ered with a water-filled condom to allow good contact with the rectal wall. After insertion into the rectum and attachment 
to brachytherapy assembly, which includes a needle guidance template and a manual stepper, the probe is typically 
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withdrawn in 5 mm steps, wliile a 2D image is digitized at eacli step. Since most prostates are about 4 to 5 cm long, tliis 
procedure provides 8 to 10 2D transverse images for pre-implant dose planning. 

[0024] A number of investigators and companies have developed pre-planning dosimetry software, which accepts 
2D transverse ultrasound images.^ Typically, the margins of the prostate in the 2D images are contoured manually with 

5 a mouse and used in the treatment optimization software, which yields source positions for target coverage. 

[0025] During the implantation phase, at a subsequent visit, the patient is positioned in a similar orientation to the 
pre-planning position. Once the TRUS probe is in position, needles are inserted under TRUS guidance. Since the nee- 
dles are often deflected during insertion, 2D TRUS visualization helps the oncologist to detect the deflection. If the 
oncologist believes that the deflection is significant, then the needle is reinserted. Because the elevational resolution is 

10 poor (beam width of a few mm), use of 2D TRUS is not sensitive to deflection across the beam (Figure 6). In addition, 
once several needles have been inserted, visualization is made difficult by the acoustic artifacts produced by the seeds. 
This can be minimized by inserting the more anterior seeds first, so that the artifacts they produce do not obscure the 
needles positioned more posteriorly. 

[0026] Using the 3D TRUS method of the present invention, alleviates some of the technical limitations of 2D TRUS. 
15 Moreover, allowing interactive viewing of the prostate in 3D makes it ideal for treatment planning prior to implantation 
and allows 3D monitoring of seed and needle placement during implantation. This not only enhances placement accu- 
racy, but also allows for needle and seed placement verification. Thus, any detected errors can be compensated for by 
performing a replan and adjusting subsequent seed locations accordingly. 

20 Limitations of 2D TRUS-quided brachvtherapv addressed by the present invention 

[0027] Some of the limitations of ultrasound imaging are related to fundamental physical aspects of the interaction 
of ultrasound with tissues, resolution limitations and the detection of the ultrasound echoes. Progress in overcoming 
these limitations is being made by the ultrasound machine manufacturers. However, advances in ultrasound imaging 
25 afforded by 3D ultrasound will have an equal or greater impact on prostate brachytherapy specifically (and other pros- 
tate therapies) with the development of identification, quantification and guidance tools based on 3D TRUS. The 
present invention addresses the following limitations of 2D ultrasound: 

• Conventional ultrasound images are 2D, hence, the oncologist must mentally integrate multiple images to develop 
30 a 3D impression of the anatomy/pathology during the image guided therapeutic procedure. This practice is time- 
consuming, inefficient, and requires a highly skilled operator, all of which can potentially lead to incorrect therapeu- 
tic decisions. 

• Therapeutic decisions require accurate estimation of the tumor and organ volume. The variability in TRUS prostate 
35 imaging and volume measurements using a conventional 2D technique is high, because current ultrasound volume 

measurement techniques assume an idealized elliptical shape and use only simple measures of the width in two 
views. ^ Although manual contouring of sequential cross-sectional prostate images has reduced this variability, this 
approach is time-consuming and arduous, making it impractical during an intra-operative procedure. Fast 3D pros- 
tate image acquisition with semi-automatic prostate contouring overcomes this problem. 

40 

• It is difficult to localize the thin 2D ultrasound image plane in the organ, and difficult to reproduce a particular image 
location at a later time, making 2D TRUS a limited imaging modality for implantation based on a previously obtained 
set of 2D images, and for follow-up patient studies. 

45 • Previous reports have shown that volumes measured with TRUS are substantially lower than those measured with 
CT and MR and the volumes of the resected glands. Underestimation of the prostate volume can lead to significant 
underdose of the prostate periphery. This error could be partially due to the assumption that the prostate is elliptic 
and basing the measurement on diameters from two orthogonal images, or due to the contouring of the prostate 
using too large a distance between cross-sections.® The intra-operative 3D ultrasound imaging method of the 

50 present invention incorporates an accurate and precise prostate contouring algorithm which substantially mini- 

mizes this problem. 

• TRUS images deteriorate because of shadowing and multiple echoes as needles and seeds are introduced into the 
prostate. Thus, identification of individual sources in 2D images is very difficult, requiring the use of CT or fluoros- 

55 copy. The use of 3D TRUS images, rather than from just a few (8 to 1 0) 2D cross-sectional images, provides suffi- 

cient information to localize the needles and seeds in the prostate. 

[0028] Although 2D TRUS-guided prostate planning and implantation is useful in providing a method for treatment 
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of the prostate, and technical strides in prostate brachytherapy have improved the accuracy and consistency of source 
placement,^ the 2D TRUS approach still suffers from those disadvantages as described above, which must be over- 
come before it can be used consistently in a comprehensive intra-operative therapeutic approach. The Applicant has 
now developed a TRUS-guided intraoperative branchytherapy method using 3D ultrasound which obviates the need for 
5 a CT-based preplan. This developed method and system permits planning and implantation at the same session 
thereby avoiding problems of repositioning, prostate motion, prostate size/contour changes, and image registration 
between modalities. This also permits post-implant verification, allowing immediate corrections of errors in implantation. 
The present intra-operative system and method integrates the planning software with semi-automatic prostate contour- 
ing, needle and seed detection algorithms and real-time comparisons to the preplan (Figures 1-5). 

10 [0029] The present invention overcomes the above listed limitations of 2D TRUS by using a 3D TRUS-based sys- 
tem for planning, real-time image-guidance, and post-implant verification of prostate brachytherapy. 
[0030] In general, the image-guided interventional method of the present invention progresses through three 
phases: 1) preoperative planning; 2) implantation: and 3) monitoring. During each phase, various new hardware and 
software components are used, which are integrated into a useful operating-room system. Figures 1 -5 show flow charts 

15 of the steps in the procedure, as well as details of the procedure and the software modules in each step. 

[0031] During the pre-implant planning phase, the optimal distribution of the therapy sources is determined. This 
requires accurate knowledge of the 3D geometry of the prostate and the sensitive surrounding structures, and an accu- 
rate dose planning algorithm. Currently, 2D CT or TRUS images obtained every 5 mm are used with manual prostate 
contouring as inputs into the dose-planning software. In the present invention, these techniques are replaced with a 3D 

20 TRUS technique and semi-automated contouring and integrated with treatment planning software to allow fast on-line 
planning. 

[0032] The objective of minimally invasive therapy techniques is to be "conformal", i.e., to give a lethal dose to the 
entire prostate, while limiting the dose to the surrounding normal structures. Thus, once planning is complete, the 
implantation phase of the procedure requires exact positioning of needles delivering the individual therapy sources 

25 within the prostate. To accomplish this, accurate and precise implantation and verification are crucial. This requires a 
system that provides accurate and precise geometric information not only at the pre-implant planning stage, but also 
during the implantation procedure in the operating room. 2D TRUS images do not provide sufficient information to 
accomplish this accurately. Real-time 2D TRUS is still utilized to visualize the needle, but software tools are added to 
guide it in the 3D image to the pre-planned location, followed by 3D TRUS to verify the final source locations in 3-dimen- 

30 sions. 

[0033] Once the therapy has been administered, post-plan verification is important. A CT scan is usually carried out 
to verify that the seeds are in their planned locations and to generate a post-plan, although corrections are not generally 
performed. Clearly, fast and accurate tools to perform this task intra-operatively will allow immediate corrections and 
change the way prostate brachytherapy is performed. The present invention uses software to identify the seeds in the 
35 prostate using 3D TRUS, and register each 3D ultrasound image with previous ones (3D TRUS and CT if available), 
allowing error corrections during the implantation phase (Table 1). 

3D TRUS guidance assemblv 

40 [0034] Over the past decade, investigators have refined the conventional TRUS-guided prostate brachytherapy pro- 
cedure and increased its popularity''. The conventional procedure is performed on an outpatient basis under general or 
spinal anaesthesia, while the patient is placed in the lithotomy position. To reduce the variability and standardize the 
procedure, a mechanical assembly is used, which houses the TRUS transducer, a stepper unit and a needle template 
(Figure 6). The stepper allows the operator to withdraw the transducer in steps (e.g., 5 mm) and collect the sequence 

45 of 2D images needed for the pre-plan. This approach allows pre-planning of the procedure, and insertion of the needle 
according to selected holes in the template (Figure 6B and 9). In the present method and system, a rotational 3D scan- 
ning assembly is used as described in U.S. Patent 5,454,371 (the contents of which are incorporated herein). The 
mechanism is composed of a universal mechanical assembly to move the conventional TRUS ultrasound transducer. 
The mechanical assembly incorporates a motor and a drive, which can cause the transducer to rotate along its long axis 

50 at a constant angular velocity. 

[0035] As the ultrasound transducer is rotated, the sequence of ultrasound images produced by the conventional 
ultrasound imaging system are digitized and stored in the computer using a conventional video digitizing computer 
board. The images are reconstructed into a 3D image (Figure 7) as described by U.S. Patents 5,562,095, 5,454,371 
and 5,842,473 (the contents of which are incorparated herein). 

55 [0036] When the 3D image is obtained, a series of lines are superimposed onto it, each one corresponding to the 
projected trajectory of a needle (Figure 8). The oncologist then views this image before implantation to assess potential 
pubic arch interference, and after implantation to assess the isodose distributions in 3D. 
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Prostate segmentation algorithm 

[0037] 3D treatment planning requires tliat tlie 3D image of tine prostate and otiner anatomical structures (rectal 
wall, urethra, bladder) be segmented. Currently, prostate images are segmented via manual planimetry. In this 
5 approach, the operator manually outlines the prostate and other structures in the 2D images obtained every 5mm. 
Since this task is arduous, time-consuming and prone to variability,^"® the present approach uses a segmentation algo- 
rithm that requires minimal interaction and processing time. 

[0038] The objective of the segmentation algorithm is to extract the prostate shape and volume from the image. 
While segmentation of the prostate is described herein, it is understood by those skilled in the art that the same 

10 approach may be applied to the bladder and rectal wall. In situations in which the image contrast is great (e.g., in fluid 
filled regions in ultrasound images), the segmentation task is relatively easy and many approaches can be used. How- 
ever, ultrasound images of the prostate are very difficult to segment because the contrast is low, the image suffers from 
speckle, and parts of the prostate boundary may not be visible due to shadowing and refraction artifacts. In the present 
invention a semi-automatic approach is used based on active contours that completes the segmentation of the prostate 

15 with an error of less than 1 0%. 

Needle segmentation algorithm 

[0039] During implantation, needles are inserted approximately perpendicular to the ultrasound beam and with- 
20 drawn while dropping radioactive seeds. To ensure that the seeds are dropped at the preplanned positions, the needles 
must be inserted along the correct trajectory. If significant (>5mm) errors are detected, the operator must decide 
whether to withdraw and reinsert the needle. However, using the intra-operative system of the present invention with 
needle segmentation, then a rapid re-plan (0.5 sec/seed) may be performed by updating the 3D dose distribution based 
on the real needle trajectory and hypothesized seed locations (e.g., every 5 mm). Although needles are inserted with 
25 real-time 2D TRUS guidance, it is the experience from prostate cryosurgery, that because of poor elevational resolution 
(i.e., thick TRUS beam), lateral deflection is not detected easily. Since the needle is reconstructed from multiple 2D 
images in 3D TRUS, the trajectory of the needle can be detected in a coronal section (Figure 11). Clearly, the present 
efficient method to determine the location of the needle and its true trajectory in the prostate in 3D improves the proce- 
dure. 

30 [0040] The present method rapidly segments the needles in the 2D and 3D TRUS images for guidance, and in the 
3D TRUS images for verification with an error of less than ±1 mm and an angular deflection of less than ±20. 
[0041] The needle segmentation procedure follows 3 steps. The first step is to enhance the needle contrast by 
applying a variance filter to the 3D image. The optimum kernel size for this filter is 1 11 x 11 as shown in Figure 1 0. The 
second step applies a threshold operation and create a binary image. This yields an image composed of clusters of vox- 

35 els from the needle, and clusters from other specular reflectors. The third step uses principle component analysis to 
classify each cluster according to its slope and intercept. All clusters from the needle, being collinear, will be similar, so 
that the others can be eliminated. Results are shown in Figures 10 and 12. 

Brachvtherapv seed segmentation technique 

40 

[0042] Currently, TRUS is not used for seed location verification because the seeds are too difficult to identify in 2D 
ultrasound images. Therefore it cannot be used to obtain a post-implant dose distribution. If brachytherapy seeds could 
be detected consistently and accurately using TRUS, then the post-treatment isodoses could be obtained in the treat- 
ment room, thereby removing the necessity of the CT scan and making the brachytherapy procedure more efficient and 
45 cost effective. 

[0043] Prostate brachytherapy is often difficult. Factors such as prostate motion and swelling during implantation, 
TRUS imaging artifacts, sliding and migration of the seeds in the needle tracks, and needle deflection all contribute to 
errors between the pre-plan and the actual dose distribution in the prostate. Thus, a verification of the actual locations 
of the seeds with respect to the prostate margins, rectal wall and bladder is needed immediately after implantation. 

50 Although there is no generally accepted verification approach, it is typically done with CT, which shows the sources and 
prostate margins. Since this is performed after the implantation procedure, it does not permit corrections intra-opera- 
tively. This leads to potential inaccuracies since the patient is not necessarily in the identical position as during implan- 
tation, and discrepancies have been reported between CT-and TRUS-based prostate volume measurements. Clearly, 
a technique to identify seed locations intra-operatively in one session is most important, as it allows correction during 

55 the procedure, thereby increasing the accuracy and reducing the variability of the procedure. The use of 3D images as 
in the method of the present invention provides information on the 3D shape of the seeds and gives the information to 
segment the seeds from the cluttered background. 

[0044] With 2D TRUS, the accurate delivery of prostate therapy depends on the operator's knowledge of TRUS, 
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his/her skill In manipulating the transducer orientation, and facility for mentally reconstructing an accurate 3D impres- 
sion of the prostate from multiple 2D images. With the present 3D TRUS method and system, multiple (about 100) 2D 

images are obtained in less than 7 seconds and the 3D image is reconstructed automatically in less than 1 second, 
making the visualization process faster, more standardized, and more objective, thereby improving the accuracy and 
5 reproducibility of the brachytherapy procedure. 

[0045] The 3D TRUS-based Intra-operatlve procedure of the present Invention, with specialized tools for fast and 

accurate pre-implant planning, implant guidance, implant evaluation, post-implant and long term follow-up, greatly 
improves current percutaneous prostate brachytherapy by making it more accurate, consistent and cost-effective. This 
approach is less operator-dependent and more reproducible. This represents a major improvement over current prac- 
10 tice. The improved prostate visualization afforded by 3D TRUS imaging yields better volume definition, treatment plan- 
ning, monitoring, follow-up, and overall management of prostate brachytherapy. It is understood by those skilled in the 
art that the method and system 

[0046] described herein may also be adapted to other ultrasound guided, minimally invasive prostate therapies, 
such as cryosurgery, photodynamic therapy, photocoagulation and thermal therapy. Furthermore, the method and sys- 
15 tem of the present invention may be used for the therapy of other organs, such as the liver, breast and brain. 

[0047] Variations and modifications of the present invention should be apparent to those of skill in the art without 
departing from the scope of the present invention as defined by the appended claims. 



Table 4 



Values of the the standard error of measurements for determining the coordinates of brach- 
ytherapy seeds in 3D ultrasound images of an agar phantom. Also tabulated are the mini- 
mum detectible change in the coordinate. 


Coordinate 


SEMjnter (mm) 


SEMjntra (mm) 


Ajnter (mm) 


Antra (mm) 


X 


0.30 


0.28 


0.82 


0.78 


Y 


0.35 


0.33 


0.97 


0.91 


Z 


0.36 


0.29 


0.98 


0.79 
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5 

Claims 

1. A 3D ultrasound guided intraoperative method for the diagnosis and treatment of diseased tissues, said method 
comprising the steps of: 

10 

a pre-implant planning phase for producing a 3D tissue image comprising shape and volume of said tissue and 
surrounding structures and determining optimal distribution of a selected therapy; 

a needle implantation phase for needle segmentation and positioning for delivery of the selected therapy to 
said tissue; 

15 a post-plan monitoring phase to verify the therapy implantation and for allowing error correction. 

2. The method of claim 1, wherein said pre-implant planning phase is conducted using 3D ultrasound and a tissue 
contouring algorithm to extract the 3D tissue image and preferably wherein a treatment planning algorithm is incor- 
porated in the pre-implant planning phase to allow fast on-line selected therapy planning. 

20 

3. The method of claim 1 , wherein said needle implantation phase comprises; 

enhancing needle contrast by applying a variance filter to the 3D image; 

applying a threshold operation to create a binary image composed of a cluster of voxels from the needle and 
25 other specular reflectors; and 

utilising principle component analysis to classify each cluster of voxels according to voxel slope and intercept. 

4. The method of any preceding claim wherein said method is used to diagnose and treat diseases of the prostate, 
liver, breast and brain, for example prostate cancer. 

30 

5. The method of claim 1 , wherein said therapy is selected from the group consisting of brachytherapy, cryosurgery, 
photodynamic therapy, photocoagulation therapy and thermal therapy. 

6. A 3D ultrasound guided intraoperative prostate brachytherapy method for the diagnosis and treatment of prostate 
35 cancer, said method comprising: 

a pre-implant planning phase for producing a 3D image of the prostate and surrounding structures and deter- 
mining optimal distribution of the brachytherapy; 

a needle implantation phase for needle segmentation and positioning for delivery of the brachytherapy to the 
40 prostate; 

a post-plan monitoring phase for verifying the needle implantation of the brachytherapy and for allowing error 
correction during the needle implantation phase. 

7. The method of claim 6, wherein a rotational 3D TRUS transducer is used to provide a sequence of ultrasound 
45 images of the prostate which are further digitised, stored and reconstructed into the 3D image of the prostate, and 

preferably wherein a series of lines are semi-automatically superimposed on the 3D image of the prostate defining 
a projected trajectory for implantation of the needle. 

8. The method of claim 6 wherein said needle is positioned perpendicular to an ultrasound beam and withdrawn as 

50 radioactive seeds are dropped in the prostate. 

9. The method of claim 6 wherein said needle segmentation comprises: 

enhancing needle contrast by applying a variance filter to the 3D image; 
55 applying a threshold operation to create a binary image composed of a cluster of voxels from the needle and 

other specular reflectors; and 

utilising principle component analysis to classify each cluster of voxels according to voxel slope and intercept. 
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0. A 3D ultrasound guided intraoperative system for tine diagnosis and treatment of prostate cancer, said system com- 
prising: 

a 3D TRUS transducer for producing a 3D image of said prostate and surrounding structures; 
a first computer means for determining a needle trajectory for optimal distribution of brachytherapy; 
at least one needle for implanting brachytherapy to said prostate along said needle trajectory; and 
a second computer means for verifying implantation of said brachytherapy to said prostate. 

1. A method of planning and monitoring needle implantation in diseased tissue, comprising the steps of: 

a pre-implant planning phase for producing a 3D tissue image comprising shape and volume of said tissue and 
surrounding structures for planning needle implantation; 
a monitoring phase for monitoring needle implantation; and 

a post-plan monitoring phase to verify the needle implantation and for allowing error correction, in which the 
various steps are carried out at the same session. 

2. An apparatus for the diagnosis and treatment of diseased tissue, said apparatus comprising: 

a 3D ultrasound transducer for producing a 3D image of said tissue and surrounding structures; 
a first computer means for determining a needle trajectory for optimal distribution of a selected therapy; 
at least one needle for implanting said selected therapy to said tissue along said needle trajectory; and 
a second computer means for verifying the therapy implantation to said tissue. 

3. Use of an apparatus as claimed in claim 12 in a method as claimed in any of claims 1 to 11 . 
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FIGURE 4 
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FIGURE 6 (a) 




FIGURE 6 (b) 
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FIGURE 9 (a) 




FIGURE 9 (b) 
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